Display apparatus and control methods thereof

ABSTRACT

A display apparatus includes a communication interface configured to communicate with another display apparatus, a display configured to display contents being shared with the other display apparatus and a video call user interface (UI) for a video call with a user of the other display apparatus, and a processor, in response to at least one of a gesture and a voice of the user included in video call data received from the other display apparatus satisfying a predetermined condition, configured to control the display to change a size of the video call UI displayed on the display.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. application Ser. No.15/394,026, filed Dec. 29, 2016, which claims priority from KoreanPatent Application No. 10-2016-0001629, filed in the Korean IntellectualProperty Office on Jan. 6, 2016, the contents of which are incorporatedherein by reference in their entireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa display apparatus and a control method thereof, and more particularly,to a display apparatus which performs a video call with another displayapparatus and a control method thereof.

2. Description of the Related Art

Due to development of electronic technology, various types of electronicdevices are widely used in various fields. Particularly, a displaydevice that may share contents with another display device on a realtime basis and perform a video call at the same time has been developed.

However, due to restriction in a display area, when a video call userinterface (UI) is displayed to be large, it may prevent a user'swatching contents. On the other hand, if a video call UI is displayed tobe small, meaning of video call is discolored.

Accordingly, there is a use for detecting utilization of video callfunction and changing a video call UI flexibly while not hinderingwatching of contents.

SUMMARY

One or more exemplary embodiments provide an apparatus which change asize of a video call UI according to a behavior of a counterpart of avideo call and a control method thereof.

According to an aspect of an exemplary embodiment, there is provided adisplay apparatus including a communication interface configured tocommunicate with another display apparatus; a display configured todisplay contents that are shared with the other display apparatus,together with a video call user interface (UI) for a video call with auser of the other display apparatus; and a processor configured to, inresponse to determining that at least one from among a gesture of theuser and a voice of the user included in video call data received fromthe other display apparatus satisfies a predetermined condition, controlthe display to change a size of the video call UI displayed on thedisplay.

The processor may be further configured to, in response to the at leastone from among the gesture and the voice of the user included in thevideo call data received from the other display apparatus beingrecognized for longer than a predetermined time, gradually enlarge thesize of the video call UI displayed on the display.

The processor may be further configured to, in response to a level ofthe voice of the user included in the video call data received from theother display apparatus being greater than a predetermined amount,enlarge the size of the video call UI to a predetermined size displayedon the display.

The processor may be further configured to, in response to the level ofthe voice of the user being greater than a volume of the contents,enlarge the video call UI displayed on the display to the predeterminedsize.

The processor may be further configured to, in response to the voice ofthe user not being recognized for a predetermined time while the videocall UI displayed on the display is enlarged to the predetermined size,return the video call UI displayed on the display to a size prior tobeing enlarged.

The processor may be further configured to, in response to the at leastone from among the gesture and the voice of the user being recognizedfrom voice call data received from the other display apparatus, controlthe display to provide a predetermined visual feedback at an edge of thevideo call UI displayed on the display, and in response to the at leastone from among the recognized gesture and the recognized voice of theuser satisfying a predetermined condition, change the size of the videocall UI displayed on the display.

The processor may be further configured to, in response to the gestureand the voice of the user of the other display apparatus not beingrecognized from video call data received from the other displayapparatus, replace the video call data displayed in the video call UIwith a predetermined image.

The processor may be further configured to, in response to the at leastone from among the gesture and the voice of the user included in videocall data received from the other display apparatus not being recognizedfor longer than a predetermined time, gradually reduce the size of thevideo call UI displayed on the display.

The processor may be further configured to receive privacy levelinformation of the user of the other display apparatus from the otherdisplay apparatus, and change the size of the video call UI displayed onthe display based on the received privacy level information.

The processor may be further configured to: in response to at least onefrom among the gesture and the voice of the user satisfying apredetermined condition, determine a privacy level of the user of theother display apparatus from the privacy level information; and if theprivacy level of the user is less than a predetermined level, change thesize of the video call UI displayed on the display, and if the privacylevel is greater than or equal to the predetermined level, maintain thesize of the video call UI displayed on the display.

According to an aspect of another exemplary embodiment, there isprovided a control method of a display apparatus, the control methodincluding: displaying contents that are shared with another displayapparatus, together with a video call user interface (UI) for a videocall with a user of the other display apparatus; and in response todetermining that at least one from among a gesture and a voice of theuser included in video call data received from the other displayapparatus satisfies a predetermined condition, changing a size of thevideo call UI displayed on a display.

The changing the size of the video call UI displayed on the display mayinclude, in response to the at least one from among the gesture and thevoice of the user included in the video call data received from theother display apparatus being recognized for longer than a predeterminedtime, gradually enlarging the size of the video call UI displayed on thedisplay.

The changing the size of the video call UI displayed on the display mayinclude, in response to a level of the voice of the user included in thevideo call data received from the other display apparatus being greaterthan a predetermined size, enlarging the size of the video call UIdisplayed on the display to a predetermined size.

The changing the size of the video call UI displayed on the display mayinclude, in response to the level of the user voice being greater than avolume of the contents, enlarging the video call UI displayed on thedisplay to the predetermined size.

The changing the size of the video call UI on the display may include,in response to the voice of the user not being recognized for apredetermined time while the video call UI is enlarged to thepredetermined size, returning the video call UI displayed on the displayto a size prior to being enlarged.

The changing the size of the video call UI displayed on the display mayinclude, in response to the at least one from among the gesture and thevoice of the user being recognized from video call data received fromthe other display apparatus, providing a predetermined visual feedbackat an edge of the video call UI, and in response to the at least onefrom among the recognized gesture and the recognized voice of the usersatisfying a predetermined condition, changing a size of the video callUI displayed on the display.

The changing the size of the video call UI displayed on the display mayinclude, in response to the gesture and the voice of the user not beingrecognized from video call data received from the other displayapparatus, replacing the video call data displayed in the video call UIwith a predetermined image.

The changing the size of the video call UI displayed on the display mayinclude, in response to the at least one from among the gesture and thevoice of the user included in video call data received from the otherdisplay apparatus not being recognized for longer than a predeterminedtime, gradually reducing the size of the video call UI displayed on thedisplay.

The changing the size of the video call UI on the display may includereceiving, from the other display apparatus, privacy level informationof the user of the other display apparatus, changing the size of thevideo call UI displayed on the display based on the received privacylevel information.

The changing the size of the video call UI on the display may include,in response to at least one from among the gesture and the voice of theuser satisfying a predetermined condition, when privacy level of theuser is less than a predetermined level, changing the size of thedisplayed video call UI, and when privacy level is greater than or equalto the predetermined level, maintaining the size of the video call UIdisplayed on the display.

According to an aspect of another exemplary embodiment, there isprovided an apparatus including: a communication interface configured tocommunicate with another apparatus; a processor configured to: control adisplay to display contents that are shared with the other apparatus,together with a video call user interface (UI) for a video call with auser of the other apparatus; and in response to determining that atleast one from among a gesture of the user and a voice of the user ofthe other apparatus satisfies a predetermined condition, control thedisplay to change a size of the displayed video call UI.

The processor may be further configured to, in response to the at leastone from among the gesture and the voice of the user of the otherapparatus being recognized for longer than a predetermined time,gradually enlarge the size of the displayed video call UI.

The processor may be further configured to, in response to a volumelevel of the voice of the user of the other apparatus being greater thana predetermined amount, enlarge the size of the displayed video call UIto a predetermined size.

The processor may be further configured to, in response to the at leastone from among the gesture and the voice of the user being recognizedfrom voice call data received from the other apparatus, control thedisplay to provide a predetermined visual feedback at an edge of thedisplayed video call UI, and in response to the at least one from amongthe recognized gesture and the recognized voice of the user satisfying apredetermined condition, change the size of the displayed video call UI.

The processor may be further configured to receive privacy levelinformation of the user of the other apparatus, and change the size ofdisplayed the video call UI based on the received privacy levelinformation.

According to one or more exemplary embodiments, a display device maychange a size of a video call UI according to a behavior a user at theother end of a video call and attract attentions of a user of a videocall.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects and features will be more apparent fromthe following description when taken in conjunction with theaccompanying drawings, in which:

FIG. 1 is a diagram illustrating a video call system, according to anexemplary embodiment;

FIGS. 2A and 2B are diagrams illustrating a configuration of a displayapparatus, according to an exemplary embodiment;

FIG. 3 is a diagram illustrating a method for changing size of a videocall UI, according to an exemplary embodiment;

FIGS. 4A to 4C are diagrams illustrating an example of an operationaccording to a user voice;

FIGS. 5A and 5B are diagrams illustrating an example of a method forproviding a visual feedback to a video call UI;

FIG. 6 is a diagram illustrating an operation in a case in which a useris not recognized, according to an exemplary embodiment;

FIG. 7 is a diagram illustrating an operation to reduce a video call UI,according to an exemplary embodiment;

FIG. 8 is a flowchart illustrating an operation according to a privacylevel, according to an exemplary embodiment;

FIG. 9 is a flowchart to describe an operation according to a privacylevel, according to another exemplary embodiment of the presentdisclosure; and

FIG. 10 is a flowchart illustrating a control method of a displayapparatus, according to an exemplary embodiment.

DETAILED DESCRIPTION

Exemplary embodiments are described below in detail with reference tothe accompanying drawings. The same or similar components may bedesignated by the same or similar reference numerals, although they areillustrated in different drawings. Detailed descriptions ofconstructions or processes known in the art may be omitted to avoidobscuring the subject matter of the present disclosure.

Relational terms such as first and second, and the like, may be used todistinguish one entity from another, without necessarily implying anyactual relationship or order between such entities.

The terms used herein are provided to describe exemplary embodiments andare not intended to limit the scope of the present disclosure. Asingular term includes a plural form unless clearly defined otherwise.The terms “include” and “configured to”, as used herein, are used toindicate that there are features, numbers, steps, operations, elements,parts or a combination thereof, and these terms should not exclude thepossibility of a combination or an addition of one or more features,numbers, steps, operations, elements, parts, or a combination thereof.

As described herein, a module or a unit may perform at least onefunction or operation, and may be realized as hardware, software, or acombination thereof. In addition, a plurality of modules or units may beintegrated into at least one module and may be realized as at least oneprocess, except for modules or units that should be realized inhardware. When one element is referred to as being “connected to”another element, the elements may be directly connected or a thirdelement may be connected in between. When an element is referred to asbeing “directly connected to” another element, the elements are directlyconnected without a third element connected in between.

Herein, the expression “configured to” can be used interchangeably with,for example, “suitable for”, “having the capacity to”, “designed to”,“adapted to”, “made to”, or “capable of”. The expression “configured to”does not necessarily mean “specifically designed to” in a hardwaresense. Instead, under some circumstances, “a device configured to” mayindicate that such a device can perform an operation along with anotherdevice or part. For example, the expression “a processor configured toperform A, B, and C” may indicate an exclusive processor (e.g., anembedded processor) to perform the corresponding operation, or ageneric-purpose processor (e.g., a central processing unit (CPU) orapplication processor (AP)) that can perform the correspondingoperations by executing one or more software programs stored in thememory device.

Technical terms used herein are to be used for the purpose of describingexemplary embodiments, and are not intended to limit the scope. Inaddition, the technical terms used herein are to be interpreted as isunderstood in the present disclosure by those of ordinary skill in theart, unless they are specifically defined by other means. Further, whentechnical terms do not accurately represent the features of the presentdisclosure, they may be replaced with meanings determined by one ofordinary skill in the art. In addition, the terms used herein, which aredefined as provided in advance, or which are to be interpreted accordingto the context before and after, are not to be construed as having ameaning in an excessively reduced manner.

Expressions such as “at least one of,” when preceding a list ofelements, modify the entire list of elements and do not modify theindividual elements of the list.

Below, one or more exemplary embodiments will be described in greaterdetail with reference to the drawings.

FIG. 1 illustrates a video call system 1000 according to an exemplaryembodiment. As illustrated in FIG. 1, the video call system 1000includes a display apparatus 100 and a different display apparatus 200.

The display apparatus 100 can be embodied as various types of deviceshaving display functions such as a monitor, TV, and kiosk. The displayapparatus 100 may be embodied as a stationary type apparatus.

The display apparatus 100 may communicate with the different displayapparatus 200. The display apparatus 100 may transmit and receive videodata and audio data to perform a video call with the different displayapparatus 200. Video data may be video data captured by the differentdisplay apparatus 200, and audio data may be audio data input to thedifferent display apparatus 200.

The display apparatus 100 may share contents, in addition to conductinga video call with the different display apparatus 200. For example, thedisplay apparatus 100 may transmit movie content to the differentdisplay apparatus 200 and reproduce it on a real time basis.

To share contents, the display apparatus 100 may transmit contents tothe different display apparatus 200. The display apparatus 100 mayreceive contents to share from the different display apparatus 200. Thedisplay apparatus 100 and the different display apparatus 200 mayreceive the same contents from a server, etc., and display the contentson a real-time basis.

The display apparatus 100, while displaying contents which are beingshared with the different display apparatus 200 on a real-time basis,may conduct a video call. In this case, the display apparatus 100 maydisplay a video call UI on one side of a display area.

In particular, the display apparatus 100, when at least one of a usergesture and a voice included in the video call data received from thedifferent display apparatus 200 satisfies a preset condition (e.g.,predetermined condition), may change a size of a video call UI anddisplay the UI.

For example, when an operation such as shaking arms of a user of thedifferent display apparatus 200 is sensed, the display apparatus 100 maymagnify size of the video call UI and display it.

The different display apparatus 200 may be embodied as various types ofapparatuses having display function such as a monitor, TV, and kiosk. Inparticular, the different display apparatus 200 may be an apparatuswhich is the same as the display apparatus 100, and perform the samefunction as the display apparatus 100 and thus, detailed descriptionwill be omitted.

FIGS. 2A and 2B are block diagrams illustrating features of the displayapparatus 100 according to an exemplary embodiment.

As illustrated in FIG. 2A, a display apparatus 100 includes acommunication interface 110, a display 120, and a processor 130.

The communication interface 110 may communicate with the differentdisplay apparatus 200. The communication interface 110 may transmit andreceive contents which are being shared with the different displayapparatus 200 on a real-time basis, and transmit and receive datarelating to video call.

The communication interface 110 may perform unidirectional orbidirectional communication with the different display apparatus 200.The communication interface 110 may perform unidirectional communicationto transmit, to the different display apparatus 200, the shared contentson a real time basis, or receive, from the different display apparatus200, the content. The communication interface 110 may performbidirectional communication while transceiving video call data with thedifferent display apparatus 200.

The display 120 may display contents being shared on a real time basiswith the different display apparatus 200 by control of the processor 130and video call UI with a user of the different display apparatus 200.For example, the display 120 may display the content being shared on areal-time basis on an entire display area and display a video call UI onan area of a display to be overlapped.

In addition, the display 120 may be embodied as a liquid crystal display(LCD) panel or an organic light emitting diode (OLED) display, but isnot limited thereto. The display 120 can be embodied as a flexibledisplay and a transparent display according to some cases.

The processor 130 controls overall operation of the display apparatus100.

The processor 130, when at least one of gesture and voice included invideo call data received from the different display apparatus 200satisfies a preset condition, may control the display 120 to change asize of a video call UI and display the UI.

The processor 130, when at least one of gesture and voice of a userincluded in video call data received from the different displayapparatus 200 is recognized for more than a preset time (e.g.,predetermined time), may control to gradually magnify the video call UIand display it.

The processor 130, when user voice included in video call data receivedfrom the different display apparatus 200 is greater than or equal to apreset size (e.g., predetermined size), may control to magnify videocall UI to a preset size and display the UI.

The processor 130, when a user voice is greater than or equal tocontents volume, may control to magnify video call UI to a preset sizeand display the UI.

The processor 130, while the video call UI is magnified to a presetsize, when a user voice is not recognized for a preset time, may controlto return the magnified video call UI to a size immediately before beingmagnified and display the UI.

In addition, the processor 130, when at least one of gesture and voiceof a user is recognized from video call data received from the differentdisplay apparatus 200, may control to provide preset visual feedback toan edge of the video call UI, and when at least one of the recognizeduser gesture and voice satisfies a preset condition, change size of thevideo call UI and display the UI.

In addition, the processor 130, when gesture and voice of a user is notrecognized from video call data received from the different displayapparatus 200, may control to replace video call data displayed on thevideo call UI to a preset image and display.

The processor 130, when at least one of a gesture and a voice includedin video call data received from the different display apparatus 200 isnot recognized for more than preset time, may control to graduallyreduce video call UI and display the UI.

The processor 130 may control to receive from the different displayapparatus 200 user privacy level information, and based on the receivedprivacy level information, change size of the video call UI and displaythe UI.

Here, the processor 130, when at least one of a user gesture and a voicesatisfies a preset condition, when privacy level of a user is less thanpreset level, may control to change size of video call UI and displaythe UI, and when the level is greater than or equal to preset level,control not to change size of the video call UI.

FIG. 2B is a block diagram illustrating an example of the displayapparatus 100. Referring to FIG. 2B, the display apparatus 100 includesthe communication interface 110, the display 120, the processor 130, auser interface 140, a storage 150, an audio processor 160, a videoprocessor 170, a speaker 180, a button 181, a camera 182, and amicrophone 183. The elements that are overlapped with the elements ofFIG. 2A will not be further described.

The communication interface 110 may include a Wi-Fi Chip 111, aBluetooth Chip 112, a wireless communication chip 113, and a near fieldcommunication (NFC) chip 114.

The processor 130 controls overall operations of the display apparatus100 using various programs stored in the storage 150.

The processor 130 may include RAM 131, ROM 132, main CPU 133, graphicprocessor 134, first to nth interface 135-1˜135-n, and bus 136.

The RAM 131, ROM 132, main CPU 133, graphic processor 134, the first tonth interface 135-1˜135-n, etc. can be interconnected through the bus136.

The first to nth interface 135-1 to 135-n are connected withaforementioned elements. One of the interfaces can be a networkinterface that is connected with an external device through network.

The main CPU 133, by accessing the storage 150, performs booting usingO/S stored in the storage 150. Using various programs stored in thestorage 150, various operations are performed.

The ROM 132 stores a command set for system booting therein. When aturn-on command is input and power is supplied, the main CPU 133 copiesO/S stored in the storage 150 according to a command stored in the ROM132 to the RAM 131, and booths system by executing the O/S. When bootingis completed, the main CPU 133 copies various application programsstored in the storage 150 to the RAM 131, and executes variousoperations by executing an application program copied to the RAM 131.

The graphic processor 134, using a calculator and a renderer, generatesa screen including various objects such as an icon, an image, and text.The calculator, based on the received control command, calculatesattribute values such as a coordinate value where each object is to bedisplayed according to layout of a screen, shape, size, and color. Therenderer generates a screen of various layouts including objects basedon attribute values calculated from calculator. The screen generatedfrom the renderer is displayed within a display area of the display 120.

The above-described operations of the processor 130 can be performed bya program stored in the storage 150.

The storage 150 stores various data such as an operation system (O/S)software module for operating the display apparatus 100, video dataanalysis module, audio data analysis module, video call module, andcontents sharing module.

In this case, the processor 130, based on information stored in thestorage 150, may display contents being shared on a real time basis withthe different display apparatus 200 and video call UI.

A user interface 140 receives various user interactions. Here, the userinterface 140 can be embodied as various types according to exemplaryembodiments of the display apparatus 100. When the display apparatus 100is embodied as a digital TV, the user interface 140 can be embodied as aremote controller receiving unit which receives a remote control signalfrom a remote control device, a camera which detects user motion, and amicrophone which receives user voice. In addition, when the displayapparatus 100 is embodied as a touch-based electronic apparatus, theuser interface 140 may be embodied as a touch screen which has mutuallayer structure with a touch pad. In this case, the user interface 140may be used as the above-described display 120.

A touch sensor may be embodied as capacitive or resistive. Thecapacitive sensor indicates a sensor which calculates a touch coordinateby sensing electricity which is transferred to a human body, when a partof a user's body is touched with a surface of a display, using dialectcoated on the display surface. Resistive touch sensor includes twoelectrode plates provided in the display apparatus 100, and when a usertouches the surface, upper and lower plates of a touched point are incontact with each other, sensing flow of current. In addition, infraredlight sensing method, surface ultrasonic wave transfer method, integraltension measurement method, piezo effect method can be used for sensingtouch interaction.

The audio processor 160 is an element to process audio data. The audioprocessor 160 may perform various processing such as decoding,amplification, and noise filtering of audio data.

The video processor 170 is an element which performs video dataprocessing. The video processor 170 may perform various image processingsuch as decoding, scaling, noise filtering of video data, frame rateconversion, and resolution conversion.

The speaker 180 is an element to output various alarm sounds or voicemessages as well as various audio data processed by the audio processor160.

The button 181 may be various types of buttons such as a mechanicalbutton, touch pad, and wheel formed on a random area such as a frontportion, side portion and rear portion of outer part of the main body ofthe display apparatus 100.

The camera 182 is an element to photograph a still image or a movingimage according to control of a user. The camera 182 can be embodied asplural cameras such as a front camera and a rear camera.

The microphone 183 is an element to receive user voice and/or othersound and convert them to audio data.

Below, one or more exemplary embodiments are described.

FIG. 3 is a drawing illustrating a method for changing a video call UIaccording to an exemplary embodiment.

As illustrated in FIG. 3, the processor 130, in response to at least oneof a user gesture and voice included in video call data received fromthe different display apparatus 200 satisfying a preset condition, maycontrol the display 120 to change size of video call UI and display. Forexample, the processor 130, when user voice included in the receivedvideo call data is greater than or equal to preset size, may magnifysize of the video call UI.

Here, the processor 130 may extract a gesture and a voice of a userincluded in video call data received from the different displayapparatus 200. For example, the processor 130 may ignore horn or TVsound included in video call data and extract only user voice. Theprocessor 130 may ignore a gesture of another person other than a userfrom among video included in video call data and extract user gestureonly.

Exemplary embodiments are not limiting, and the processor 130 might notextract gesture and voice of a user, and change size of video call UIand display the UI based on at least one of a gesture and sound in videodata.

In particular, the processor 130, when at least one of user gesture andvoice included in video call data received from the different displayapparatus 200 is recognized for more than preset time, may graduallymagnify video call UI and display the UI. For example, the processor130, user voice included in the received video call data is maintainedat size more than preset size for more than 10 seconds, size of videocall UI can be magnified.

In this case, the processor 130 may ignore silence for a short timeduring a preset time. For example, the processor 130, when a user voiceis recognized for three seconds and is not recognized for one secondafterward, if the user voice is recognized again, it can be determinedthat user voice is continued.

The processor 130 may gradually expand and display the video call UI.For example, the processor 130, while displaying the first video call UI310, when a preset condition is satisfied, the size of the video call UIcan be magnified to the second video call UI 320, and the third videocall UI 330. The processor 130 may gradually expand the video call UIand display the UI.

The processor 130 may determine size of the video call UI, based on atleast one of gesture and voice of a user included in video call datareceived from the different display apparatus 200. For example, theprocessor 130 may determine size of the video call UI based on size ofuser voice. The processor 130 may determine size of the video call UIbased on duration of user voice. The processor 130 may determine size ofthe video call UI based on at least one of size and resolution of thedisplay 120.

In FIG. 3, it is illustrated that the video call UI is displayed as around shape on a right lower end, but exemplary embodiments are notlimited thereto. For example, the processor 130 may move a position ofthe video call UI to another area according to a user manipulation andchange a shape to rectangular shape.

In addition, the processor 130 may overlay the video call UI on thecontent shared on a real-time basis and display the UI. The processor130 may change transparency of the video call UI and display the UI.

The processor 130 may display that the video call UI takes a specificarea. For example, the processor 130 may reduce a display area of thecontent being shared on a real time basis as much as an area where thevideo call UI is displayed and display the area.

The processor 130 may change size of the video call UI and a shapethereof. For example, the processor 130 may magnify size of the videocall UI and change color of an edge of the video call UI or shape of thevideo call UI.

FIGS. 4A to 4C are views to illustrate an example of an operationaccording to a user voice.

As illustrated in FIG. 4A, the processor 130, when user voice includedin the video call data received from the different display apparatus 200is greater than a preset size, may magnify the video call UI to a presetsize and display.

Here, the preset size to which the video call UI is magnified can bedetermined by a user. The processor 130, based on at least one of sizeand resolution of the display 120, may determine a preset size to whichthe video call UI is magnified.

FIG. 4A illustrates an example of the video call UI 410 which ismagnified to a preset size, but it is not limited thereto. For example,the processor 130 may display the video call UI on an entire area, ordisplay at a different size and a different shape.

As illustrated in FIG. 4B, the processor 130, when user voice is greaterthan volume of the content, may magnify the video call UI to a presetsize and display. For example, the processor 130, by comparing the soundsize 420 which is being shared on a real time basis with size 430 ofvoice included in the video call data, when size of the voice 430 isgreater than size 420 of the sound, may magnify the video call UI to apreset size and display.

Here, the processor 130 may extract a user voice included in video calldata and determine size thereof. For example, the processor 130 mayignore a horn sound and a TV sound included in video call data andextract user voice only, and compare it with size of sound of thecontent.

As illustrated in FIG. 4C, the processor 130, while the video call UI ismagnified to a preset size, when user voice is not recognized for presettime, may return the video call UI to a size before being magnified anddisplay. For example, the processor 130, while the video call UI ismagnified to a preset size, when a user voice is not recognized,contents which are being shared are determined to be more importantdisplay element, and the video call UI can be reduced to the secondvideo call UI 440 to a size immediately before being magnified from thefirst video call UI 410. The processor 130 may reduce the video call UIto a different size instead of the size immediately before beingmagnified.

Here, preset time can be set by a user, or can be a time that is setwhen manufacturing the display apparatus 100.

FIGS. 5A and 5B are views illustrating an example of a method forproviding visual feedback to the video call UI. The processor 130, whenat least one of a user gesture and a voice is recognized from video calldata received from the different display apparatus 200, may providepreset visual feedback to edge of the video call UI, and when at leastone of the recognized user gesture and voice satisfies a presetcondition, may change size of the video call UI and display.

As illustrated in FIG. 5A, the processor 130, when a user gesture and avoice of a user are not recognized, may minimize a size of the videocall UI and display. In addition, the processor 130, when user's gestureis recognized, may provide visual feedback to change a color of an edgeof the video call UI or flicker. The processor 130 may provide visualfeedback to change a color of the edge of the video call UI or flickerthe UI. Accordingly, the processor 130 may attract a viewpoint of theuser of the display apparatus 100 who views contents which are beingshared on a real time basis.

Alternatively, as illustrated in FIG. 5B, the processor 130, when a usergesture and a voice are not recognized, may minimize a size of the videocall UI and display the UI. In addition, the processor 130, when theuser voice is recognized, may provide visual feedback to change a colorof an edge of the video call UI or flicker the UI. The processor 130 mayprovide visual feedback to change a color of an edge of the video callUI and flicker the UI. Accordingly, the processor 130 may attract aviewpoint of the user of the display apparatus 100 who views contentswhich are being shared on a real time basis.

The processor 130 may provide visual feedback to the video call UI onlywhen both a user gesture and a voice are recognized.

The processor 130 may provide visual feedback to the video call UI onlywhen a gesture or a voice of a user is preset gesture or voice. Forexample, the processor 130, when the user voice is a name of a user ofthe display apparatus 100, may provide visual feedback to the video callUI. The processor 130 may provide visual feedback to the video call UIwhen a user gazes at a camera provided on the different displayapparatus 200.

The processor 130, when at least one of a gesture and a voice of therecognized user satisfies a preset condition, may change a size thevideo call UI and display the UI. For example, the processor 130, whilecolor of the edge of the video call UI is changed, when the user voiceis maintained for more than preset time, may change a size of the videocall UI and display the UI.

FIG. 6 is a view to illustrate an operation of a case in which a user isnot recognized according to an exemplary embodiment.

As illustrated in FIG. 6, the processor 130, when a user video and voiceare not recognized from video call data received from the differentdisplay apparatus 200, may substitute video call data displayed on thevideo call UI with a preset image and display.

For example, the processor 130, while a first call UI 610 including auser and nearby devices is being displayed, when a user is out of theview of the camera provided on the different display apparatus 200, fora preset time, a second video call UI 620 including a video captured bythe camera provided on the different display apparatus 200 can bedisplayed. In addition, the processor 130, when preset time elapses, maydisplay a third video call UI 630 including a preset image instead of avideo photographed by the camera provided on the different displayapparatus 200.

However, exemplary embodiments are not limited thereto, and theprocessor 130, when a user is out of view of the camera provided on thedifferent display apparatus 200 without elapsing of preset time, maydisplay the third video call UI 630 including a preset image.

The processor 130, based on a preset gesture or a voice of a userinstead of a user's video, may display the third video call UI 630including a preset image. For example, the processor 130 may display thethird video call UI 630 including a preset image according a gesture tohold right hand.

The processor 130, when a gesture and a voice of a user are notrecognized for more than preset time, may display the third video callUI 630 including a preset image. For example, the processor 130, when agesture and a voice of a user are not recognized for more than 10seconds, may display the third video call UI 630 including a presetimage.

Here, the preset image may be a basic image provided from a video callapplication, or an image set by a user. The processor 130 may display animage immediately before being out of an angle of the camera provided onthe different display apparatus 200 instead of a preset image.

FIG. 7 is a view illustrating an operation to reduce the video call UIaccording to an exemplary embodiment.

As illustrated in FIG. 7, the processor 130, when at least one of thegesture and the voice of a user included in the video call data receivedfrom the different display apparatus 200 is not recognized for more thanpreset time, may gradually reduce the video call UI 710 and display thereduced video call UI 720.

For example, the processor 130, when a user included in the video calldata received from the different display apparatus 200 does not show alarge movement and does not speak, may gradually reduce the video callUI and display the reduce video call UI. That is, the processor 130,even when there is a user within an angle of the camera provided on thedifferent display apparatus 200, may gradually reduce the video call UIand display the reduced video UI.

Exemplary embodiments are not limited thereto and the processor 130 maygradually reduce the video call UI.

The processor 130, even when a user is not recognized within an angle ofthe camera provided on the different display apparatus 200, maygradually reduce the video call UI and display the UI.

As illustrated in FIG. 6, the processor 130, while the video call UIincluding a preset image is displayed, when a preset time elapses, maygradually reduce the video call UI and display the UI.

The processor 130 may reduce the video call UI and then may not displaythe video call UI. In this case, the processor 130 may ignore video dataincluded in the video call data received from the different displayapparatus 200 and output audio data only. The processor 130 may transmita signal requesting audio data only to the different display apparatus200, and receive audio data only from the different display apparatus200.

The processor 130, while performing a call with a user while the videocall UI is not displayed, when a gesture or a voice of a user isrecognized, may display the video call UI again. In this case, theprocessor 130 may receive video data and audio data from the differentdisplay apparatus 200.

The processor 130, while performing a call with a user when the videocall UI is not displayed, if a user's voice is recognized again, maydisplay the video call UI again. In this case, the processor 130 mayreceive audio data only from the different display apparatus 200.

The processor 130 may receive from a different display apparatus 200 asignal to display the video call UI, and display the video call UIagain. In this case, the different display apparatus 200 may recognizeuser gesture or voice and transmit a signal to display the video call UIagain to the display apparatus 100.

The processor 130, when a user gesture or voice is a preset gesture orvoice, may display the video call UI again. For example, the processor130 may display the video call UI again by recognizing an utterance of auser, such as “video call on.”

FIG. 8 is a flowchart to describe an operation according to privacylevel according to an exemplary embodiment.

First, privacy level information is received from the different displayapparatus 200, in operation S810. The privacy level information isinformation set by a user. For example, the privacy level informationmay be information which is divided into top, middle, and low levels.However, exemplary embodiments are not limited thereto.

The privacy level information may be information to set an operationmethod for a specific case. For example, the privacy level information,when a user is not recognized, may display a preset image, and when auser is recognized, based on at least one of user gesture and voice, mayinclude information regarding whether or not to change a size of thevideo call UI.

The processor 130, when the privacy level information is received, maydetermine whether a privacy level of a user is a preset level or more(S820). The processor 130, when the privacy level of a user is less thana preset level, when at least one of a user gesture and voice satisfiesa preset condition, changes a size of the video call UI (S830).

In addition, the processor 130, when the privacy level of a user isgreater than a preset level, does not change a size of the video call UI(S840). That is, the processor 130, even when a user gesture or voice isrecognized, may not change a size of the video call UI.

FIG. 8 illustrates that whether to change a size of the video call UImay be determined according to user privacy level information, but it isnot limited thereto. For example, the processor 130 may determinewhether to change color of an edge of the video call UI according toprivacy level information of a user.

FIG. 9 is a flowchart illustrating an operation according to privacylevel according to another exemplary embodiment.

Privacy level information of a user is received from the differentdisplay apparatus 200 (S910).

The processor 130, when privacy level information is received,determines whether a privacy level of a user is greater than presetlevel or not (S920). The processor 130, when the privacy level of a useris less than preset level, displays a real time video of a user on thevideo call UI (S930). That is, the processor 130 may display a videophotographed by the camera provided on the different display apparatus200.

The processor 130, when the privacy level of a user is greater than apreset level, displays a preset image on the video call UI (S940). Inthis case, the processor 130 may transmit a signal to request audio dataonly to the different display apparatus 200. The processor 130 maytransmit to the different display apparatus 200 a signal requesting apreset image.

FIGS. 8 and 9 illustrate that a size of the video call UI or a displayimage of the video call UI is determined according to privacy levelinformation. That is, the size of the video call UI and the displayimage of the video call UI can be determined separately.

For example, the processor 130 may change a size of the video call UIaccording to privacy level information and display a photographed imageon the video call UI, or display a preset image on the video call UIwithout changing a size of the video call UI. The processor 130, eventhough a size of the video call UI is changed according to the privacylevel information, may display a preset image on the video call UI. Theprocessor 130 may display an image photographed by a user on the videocall UI without changing a size of the video call UI.

FIG. 10 is a flowchart illustrating a method for controlling a displaydevice according to an exemplary embodiment.

In operation S1010, contents which are being shared with a differentdisplay device and video call UI with a user of a different displaydevice are displayed. In addition, when at least one of a user gestureand a voice included in the video call data received from a differentdisplay device satisfies a preset condition, a size of the video call UIis changed and displayed, in operation S1020.

Here, changing a size the video call UI and displaying the UI, inoperation S1020, when at least one of a user gesture and a voiceincluded in video call data received from a different display device isrecognized for more than preset time, may gradually expand the videocall UI and display the UI.

In addition, changing a size and displaying, in operation S1020, when auser voice included in the video call data received from a differentdisplay device is greater than a preset size, may magnify the video callUI to a preset size and display the UI.

In particular, changing a size and displaying, in S1020, when a uservoice is greater than volume of contents, may magnify the video call UIand display.

In addition, changing a size and displaying, in S1020, while the videocall UI is magnified to a preset size, when a user voice is notrecognized for a preset time, may return magnified video call UI to asize immediately before being magnified and display.

Changing a size and displaying, in S1020, when at least one of a usergesture and a voice is recognized from video call data received from adifferent display device, provide preset visual feedback to an edge ofthe video call UI, and when at least one of the recognized user gestureand voice satisfies a preset condition, change a size of the video callUI and display.

In addition, changing a size and displaying, in S1020, when user gestureand voice are not recognized from video call data received from adifferent display device, may replace video call data displayed on thevideo call UI with a preset image and display.

In addition, changing a size and displaying, in S1020, when at least oneof user gesture and voice included in video call data received from adifferent display device is not recognized for more than a preset time,may gradually reduce the video call UI and display the video call UI.

In addition, changing a size and displaying, in S1020, may receiveprivacy level information of a user from a different display device,change a size of the video call UI based on the received privacy levelinformation, and display the UI.

Changing a size and displaying, in S1020, when privacy level of a useris less than a preset level, if at least one of user gesture and voicesatisfies a preset condition, change a size of the video call UI anddisplay, and when it is greater than a preset level, may not change asize of the video call UI.

According to one or more exemplary embodiments, a display device maychange a size of the video call UI according to behavior of acounterparty to the video call and attract attention of a user of thevideo call.

According to one or more exemplary embodiments, it has been describedabove that a size of the video call UI is changed based on at least oneof a gesture and a voice of a different display device, but it is notlimited thereto.

For example, by reflecting interaction with a user of a display device,a size of the video call UI can be changed. In this case, even when atleast one of a user gesture and a voice of a different display devicesatisfies a preset condition, a size of the video call UI may not bechanged. The display device, according to at least one of a user gestureand a voice of a different display device, when a user of the displaydevice operates, a size of the video call UI can be changed.

A method for controlling a display device according to one or moreexemplary embodiments can be embodied as a program code executable by aprocessor or a computer and stored in various non-transitory computerreadable mediums to be provided to each server or device, so that it isexecutable by the processor of the server or device.

As an example, a non-transitory computer readable medium can be providedin which a program which sequentially executes the steps of displayingcontents being shared with a different display device on a real-timebasis and video call UI with a user of a different display device,receiving video call data from a different display device, and when atleast one of user gesture and voice included in video call datasatisfies a preset condition, changing a size of the video call UI anddisplaying the video call UI.

The non-transitory computer-recordable medium is an apparatus-readablemedium configured to semi-permanently store data. Specifically, theabove-described various applications or programs may be stored in anon-transitory apparatus-readable medium such as a compact disc (CD), adigital versatile disc (DVD), a hard disc, a Blu-ray disc, a universalserial bus (USB), a memory card, or a read only memory (ROM), and thenmay be provided to a user terminal device.

While exemplary embodiments have been shown and described with referenceto the drawings, it will be understood by those having ordinary skill inthe art that various changes in form and detail may be made thereinwithout departing from the spirit and scope, as defined by the appendedclaims.

What is claimed is:
 1. A display apparatus comprising: a communicationinterface configured to communicate with another display apparatus; adisplay; and a processor configured to: control the communicationinterface to receive a content that is shared with the other displayapparatus and to receive voice call data including a voice of a user ofthe other display apparatus, control the display to display the contenttogether with a video call user interface (UI) for a video call with theuser, and control the display to change a display size of a video of theuser of the other display apparatus included in the video call UI basedon a time at which the voice call data is including an audible voiceabove a defined level of the user is received.
 2. The display apparatusof claim 1, wherein the processor is further configured to, based on avolume level of the voice of the user being greater than a predeterminedamount, control the display to enlarge the display size of the video ofthe user of the other display apparatus included in the video call UI.3. The display apparatus of claim 1, wherein the processor is furtherconfigured to, based on a volume level of the voice of the user beinggreater than a predetermined amount, control the display to enlarge thedisplay size of the video of the user of the other display apparatusincluded in the video call UI and reduce a display size of the content.4. The display apparatus of claim 1, wherein the video call UI and thecontent are at least partially overlapped.
 5. The display apparatus ofclaim 1, wherein the video call UI and the content are simultaneouslydisplayed in at least some different areas.
 6. The display apparatus ofclaim 1, wherein the processor is further configured to control thedisplay to replace the video of the user of the other display apparatusincluded in the video call UI with a predetermined image.
 7. The displayapparatus of claim 1, wherein the processor is further configured to,based on a user gesture included in the video of the user of the otherdisplay apparatus included in the video call UI satisfying apredetermined condition, control the display to change the display sizeof the video of the user of the other display apparatus included in thevideo call UI.
 8. A control method of a display apparatus, the controlmethod comprising: receiving a content that is shared with anotherdisplay apparatus and receiving voice call data including a voice of auser of the other display apparatus; displaying the content togetherwith a video call user interface (UI) for a video call with the user ofthe other display apparatus; and changing a display size of a video ofthe user of the other display apparatus included in the video call UIbased on a time at which the voice call data including an audible voiceabove a defined level of the user is received.
 9. The control method ofclaim 8, wherein the changing comprises, based on a volume level of thevoice of the user being greater than a predetermined amount, enlargingthe display size of the video of the user of the other display apparatusincluded in the video call UI.
 10. The control method of claim 8,wherein the changing comprises, based on a volume level of the voice ofthe user being greater than a predetermined amount, enlarging thedisplay size of the video of the user of the other display apparatusincluded in the video call UI and reducing a display size of thecontent.
 11. The control method of claim 8, wherein the video call UIand the content are at least partially overlapped.
 12. The controlmethod of claim 8, wherein the video call UI and the content aresimultaneously displayed in at least some different areas.
 13. Thecontrol method of claim 8, further comprising: replacing the video ofthe user of the other display apparatus included in the video call UIwith a predetermined image.
 14. The control method of claim 8, whereinthe changing comprises, based on a user gesture included in the videothe user of the other display apparatus included in the video call UIsatisfying a predetermined condition, changing the display size of thevideo of the user of the other display apparatus included in the videocall UI.
 15. The display apparatus of claim 1, wherein the processor isfurther configured to, based on a volume level of the voice of the userbeing less than a predetermined level for longer than a predeterminedtime, control the display to remove the video of the user of the otherdisplay apparatus included in the video call UI.
 16. The control methodof claim 8, wherein the changing comprises, based on a volume level ofthe voice of the user being less than a predetermined level for longerthan a predetermined time, removing the video of the user of the otherdisplay apparatus included in the video call UI.
 17. The displayapparatus of claim 1, wherein the processor is further configured to,determine the display size of the video of the user of the other displayapparatus included in the video call UI based on a volume level of thevoice of the user.
 18. The display apparatus of claim 17, wherein theprocessor is further configured to, based on the volume level of thevoice of the user being smaller than a first volume level, control thedisplay to display the video of the user of the other display apparatusincluded in the video call UI at a first size, based on the volume levelof the voice of the user being greater than the first volume level andsmaller than a second volume level greater than the first volume level,control the display to display the video of the user of the otherdisplay apparatus included in the video call UI at a second size largerthan the first size, and based on the volume level of the voice of theuser being greater than the second volume level, control the display todisplay the video of the user of the other display apparatus included inthe video call UI at a third size larger than the second size.
 19. Thedisplay apparatus of claim 2, wherein the processor is furtherconfigured to, based on the volume level of the voice of the user beinggreater than the predetermined amount, control the display to enlargethe display size of the video of the user of the other display apparatusincluded in the video call UI and reduce a display size of the content.20. A display apparatus comprising: a communication interface configuredto communicate with another display apparatus; a display; and aprocessor configured to: control the communication interface to receivea content that is shared with the other display apparatus and to receivevoice call data, perform filtering on the voice call data to removesound that is not related to a user voice and extract data related to avoice of a user of the other display apparatus, control the display todisplay the content together with a video call user interface (UI) for avideo call with the user, and control the display to change a displaysize of a video of the user of the other display apparatus included inthe video call UI based on a time at which the data related to anaudible voice above a defined level of the user is received.